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ABSTRACT 


An indirect measurement of mental effort in interpreting an 
aircraft instrument was made using changes in pupil diameter and the 
latency of dilation as measures. Significance was found in latency of 
dilation across levels of Pr eoeereention difficulty, while no strat Sian 
was found for percent changes in pupil diameter. 

Results also showed a moving base-line pupil diameter for all 
subjects across trials suggesting arousal decrement for the first 
half of the experiment, with a lesser effect for the latter half of the 


experiment. 
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I. INTRODUCTION 


Although pupillary variations evoked by emotional state and mental 
activity have been observed and commented on for at least two hundred 
years, large-scale scientific investigation of the phenomenon did not be- 
gin until the work of Hess and Polt (1960). Since that time, a rash of 
work has been done in an attempt to define the dimensions of the phenom- 
enon, 

The physiology of the eye and the visual processing system is, 
needlessly to say, an exceedingly complex and, as yet, largely unexplored 
area. Adler (1970) describes the visual pathway in terms of a three part 
chain lining the eye to the visual centers in the occipital cortex. The first 
two links are contained within the retina itself, beginning with the bipolar 
cells whose dendrites connect with the photoreceptors and whose axons 
Synapse with the dendrites of the ganglion which compose the second link. 
This second neuron then connects with the last link, the lateral geniculate 
body (LGB). The visual messages are then transmitted to the cortex. Al- 
though the LGB can be viewed as merely a way station, there is evidence 
to indicate that some additional inhibitory activity reaches the LGB from 
the cortex that results in a modification of the retinal impulses; that is, 
the LGB adds its own counterpart to the messages it receives from the 


retina and transmits this in altered form to the cortex, 





Adler (1970) further notes that in man, all of the visual fibers ter- 
minate in the striate area (area 17) located in the occipital cortex. This 
is the primary visual cortical area, The impulses received by this area 
enables one only to see, that is, perceive form and color. Other parts 
of the brain perform the tasks of converting this information into con- 
scious vision. Closely connected to area 17 are two secondary areas sur- 
rounding the primary visual area: the parastriate area (area 18) and the 
pre-striate area (area 19), Area 18 is concerned with the recognition of 
objects, while area 19 is concerned with the recall of visual objects. The 
function and location of both of these areas are, however, in dispute a- 
mong investigators. These three areas are very well illustrated on page 
296 of Wright (1966). 

A fourth cortical area, the angular gyrus, functions as the storage 
area for the recognition and recall of visual speech and the memory pat- 
tern of symbols of written or printed language. That is, it provides an 
interpretative function for symbols. The major angular gyrus is closely 
associated with area 19. 

The iris is controlled by two sets of muscles, the sphincter and 
dilator. The current theory of their function is centered around the 
phenomenon of reciprocal innervation. Dilation is dependent on contraction 
of the dilator and relaxation of the sphincter. These muscles are inner- 
vated by the autonomic nervous system. The parasympathetic (involuntary) 


division of this system controls pupil size as a function of light intensities 





and accommodation. The role of the sympathetic division in controlling 
pupil size is not as clear, however. The afferent pathway from the cortical 
center to the iris is, at present, in doubt, although the centers for the 
origin of pupillary dilator impulses are located in the hypothalamus. 

The pubic are in a constant state of change, depending upon the 
changing balance between the tonus of the sphincter and dilator muscles. 
Because so many factors influence this balance, it is extremely difficult 
to isolate one from another. The various factors that influence the state 
of the pupils may be divided into two rough categories: (1) responses 
determined by light variations (light reflex) and accommodation, and (2) 
responses to sensory stimulation. It is the latter case that is of para- 
mount interest in the experiment described in this paper. 

Most of the experimental work that has been done since the pioneer- 
ing efforts of Hess and Polt (1960) can be separated into two major 
categories: those that have dealt with cognitive demand, and those 
centered around attitude and preference, Barlow (1969), in his review of 
pupillometric literature noted that the former showed consistent results, 
while the latter yielded (as might be expected) ambiguous results. Since 
the present experiment properly belongs in the first category, a short 
resume of cognitive demand experiments would be in order. 

Hess and Polt (1964), in an experiment involving multiplication prob- 
lems, found that the diameter of the pupil increased with the difficulty 


of the problem. They concluded that pupil response in this situation was 


a direct reflection of neurological activity. 





In a replication of this experiment, Hope (1971) substantiated the 
correlation of an increase in pupil diameter for correctly answered prob- 
lems but found an associated decrease in pupil diameter for incorrect 
replies. He also found that when a subject made a correct response, the 
maximum dilation reached was maintained, while for an incorrect response, 
the diameter decreased after reaching a maximum and continued to decline 
through the base-line diameter into the constriction region. He inter- 
preted this as a manifestation of cortical "overload," that is, a blocking 
out of the stimull. 

Kahneman and Beatty (1966) compared pupillary response in a short- 
term memory task with that of a long-term memory task. They found 
that the peak diameter reached during the report phase of the long-term 
task was consistently greater than fr the short-term task. They con- 
cluded that an obvious mental effort was exerted by the subjects in re- 
sponse to the cue, and that apparently this effort is at a maximum 
shortly after the cue. They cautioned, however, that retrieval of 
information from long-term memory may not invariably elicit a greater 
pupillary response than short-term memory and recall. 

Kahneman and Beatty (1967) conducted an audio-tonal discrimination 
experiment in which the subjects compared two tones and then were re- 
quired to decide whether the comparison tone was higher or lower than 
the standard tone, They found that the magnitude of dilation increased 


with the difficulty of the discrimination task. 





Paivio and Simpson (1968) conducted an experiment to investigate 
the effect on pupil diameter when an overt response indicating task ful- 
fillment was required. They found that greater dilation occurred only 
in those conditions in which an overt response was required; in this case 
pressing a key and/or verbalizing a response. They concluded that pupil- 
lary dilation is enhanced when an overt motor response is required. This 
finding substantiated the findings of others (Simpson & Paivio, 1966; 


Hakerem & Sutton, 1966). 


II.J BACKGROUND AND PURPOSE OF THE EXPERIMENT 


When an aviator flies under instrument conditions, his primary 
reference instrument is the Vertical Gyro Indicator (VGI). This device 
is essentially a gyroscope aligned with the earth's surface before take-off. 
The VGI informs the pilot of the aircraft's pitch attitude (level, climb- 
ing or diving) and roll attitude (left or right wing down, or wings level). 

It is not at all uncommon during flight for the pilot to be distracted 
from his flight instruments to make radio frequency changes, etc. , and, 
upon re-scanning the flight instruments, find that the aircraft has entered 
into an "unusual attitude," that is, an attitude not consciously directed 
by the pilot. The pilot must theninterpret what attitude the aircraft 
is in and apply the proper recovery procedure. This dual task becomes 


critically important when flying at low altitudes, such as making an 
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instrument approach, when, interestingly enough, the distractions are 
most numerous. 

Thus it is apparent that the first task, that of correct VGI inter- 
pretation, is the key factor in a safe recovery. The experiment conducted 
was designed to simulate, in part, the VGI display encountered in an 
"unusual attitude." The purpose of the experiment was to investigate 
the pupillary activity prompted by the mental activity associated with the 


interpretation of the VGI displays. 


Il. EXPERIMENTAL PROCEDURE 


A, APPARATUS 

Measurements of pupil diameter were taken and recorded by a Space 
Sciences Model 831D television pupillometer. This device is basically a 
closed circuit television system employing a signal processor to measure 
and display pupil diameter. A chart recorder integral to the unit provides 
a continuous, real-time record of the pupil diameter (see Fig. 4). 

The subjects were seated at the end of a table with their chin and 
forehead resting in an adjustable frame. The TV camera was focused on 
| the left eye. Illumination of the eye was provided by a near-infra-red, 
low-intensity light source attached to the side of the camera mount. 

The stimuli used in the experiment were black-and-white slides 


which were rear projected on a screen 36 inches from the subjects' eyes 
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by a KODAK Ektagraphic Model B-2 slide projector. The height of the 
center of the projected slides was adjusted to the level of each subject's 
eyes. 

The experiment was performed in one end of a windowless room using 
black-out curtains to achieve a semi-darkened condition. 

The slides used as test stimuli were photographs of the face of a 
VGI removed from the instrument panel of an instrument flight simulator 
(Link Trainer). The VGI was positioned to portray ten different flight 
attitudes (See App. A and Figs. 6 and 7). Six of the ten attitudes were 
in the inverted position, since they were hypothesized to be the most 
difficult to interpret, hence, evoke the greatest response. 

Before and after each stimulus slide, a control slide with the numeral 
5 in the center was projected on the screen for the subject to focus on. 
This slide served to elicit a base-line pupil diameter from which measure- 
ments of changes in diameter could be made when the stimulus slide was 
projected, 

The slides were carefully controlled for equality in brightness and 
contrast to minimize the light reflex effect. Measurements of aaa 
were taken using a light meter to insure that both control slides and 
stimulus slides were of the same luminance, as far as possible. The light 
meter readings ranged from £3.9 to £2.9. 

To provide a means of accurately event-marking the graph, the switch 


initiating slide changes was connected to the EVENT MARKER channel 


eZ 





of the pupillometer. The subjects were also provided a switch which event- 
marked the graph when they were ready to verbalize their interpretation 
of the stimulus slide. 

All experimental trials were conducted at the Naval Postgraduate 


School Human Engineering Laboratory, Monterey, California. 


B. SUBJECTS 

Twenty-one volunteer male military officers assigned to the Naval 
Postgraduate School were originally tested. However, due to difficulties 
associated with the pupillometer, the data for seven of the subjects was 
judged to be too unreliable to be useful. These problems will be discussed 
later. The remainder of this paper will, then, be based on the remaining 
fourteen subjects. 

All the subjects tested were experienced Naval Aviators from both 
the Navy and the Marine Corps, enrolled as graduate students at the 
Naval Postgraduate School. Their average age was 29, The average 
number of years of designation as an aviator was six years. Their aver- 
age total flight time was 1700 hours, ranging from 850 hours to 5000 
hours. 

Experienced pilots were selected for this experiment because of 
their familiarity with the function of the VGI as a result of their train- 
ing and experience, thus minimizing a learning effect. 

Of the fourteen subjects, half were helicopter, transport, or 


patrol pilots, while the remainder were fighter and attack pilots. For 
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the purposes of later analysis, the two groups were labeled Group A and 
Group B respectively. This division was not arbitrary. Transport, patrol, 
and helicopter pilots seldom, if ever, encounter unusual flight attitudes, 
particularly inverted attitudes, while fighter and attack pilots do. It 

was hypothesized that there should be a significant difference in pupillary 


response as a result, 


C. METHOD 

Prior to the experiment, each subject was given a brief explanation 
of the equipment and the purpose of the equipment to put the subject at 
ease and remove some of the mystery of the equipment. The experimenter 
then formally read the instructions to subjects (App. D). 

After the subject was seated, the chin rest was adjusted so that the 
head was level but comfortable. The subject was then instructed to focus 
on the numeral 5 projected on the screen while the camera and pupillometer 
were adjusted. Two practice trials were then conducted to familiarize 
the subject with the procedure and display. 

The experiment began by having the subject focus on the numeral 5 
on the control slide. The experimenter monitored the pupillary diameter 
until a reasonably steady diameter was apparent, then initiated a stimulus 
slide, As soon as the subject analyzed the attitude represented, he 
pressed the switch he held in his right hand and verbalized the response. 


The stimulus slide remained on the screen during the verbalization. 


14 





The experimenter event-marked the graph when the subject finished the 
verbalization and recorded the response. The experimenter then initiated 
a control slide, beginning the next trial. The subject was not informed of 
the correctness of his response. 


The slide order was randomized for each subject. 


D. MEASUREMENTS 

Three measurements were taken from the graph for analysis. 

(1) Latency of Dilation (LD): the time (Sec.) from slide initiation 
to maximum dilation. 

(2) Base-line Diameter (d}): the pupil diameter prior to initiation 
of a stimuli slide (usually the 3-4 sec. period prior to initiation). 

(3) Maximum diameter (d,,): the maximum pupil diameter reached 
during the interpretation of the stimuli slide. 

The scores for pupil diameter changes were calculated as percent- 


ages: 


dim ~ dp 


F X 100 = percent pupil diameter change. 
b 
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IV. DISCUSSION AND RESULTS 


The pupil reached maximum dilation an average of 0.8 seconds before 
the subjects pressed the MARK EVENT button and began verbalizing their 
analysis of the stimulus. This was of interest since it was anticipated 
that maximum dilation would occur at the moment of event-marking. Since 
the subject's chin, and consequently his head, would move while talking, 
the eye moved out of optimum camera focus. The chart output for the 
verbalization phase was ignored as a consequence. After verbalization, 
the diameter typically had returned to the base-line value. 

Since the slide projector required 1.0 second to complete a slide 
change, a momentary light reflex occurred. This reflex was very notice- 
able on the graph. Since the pupil diameter typically returned to the base- 
line level very shortly after completion of the change, and then began a 
steady increase to a maximum diameter, the slide changing appeared to 
have no appreciable confounding effect. Thus, the precaution of insuring 
equal luminance of control slides and stimuli slides as recommended by 
Woodmansee (1966) was vindicated. 

The analysis of variance of the two measures, Table I, shows that 
no significance was found for the percent pupil diameter change (PPDC), 
while the latency of dilation (LD) shows significance for the slides (VGI 


displays) main effect. To investigate this significance further, the mean 
LD was plotted with the slides ranked according to increasing mean LD of 


all subjects (Fig. 1). 
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ANALYSIS OF VARIANCE SUMMARY TABLE 


TABLET: 


/ 


Percent Pupil Diameter Change (PPDC) 


df 

Between Subjects 

Pilot Group (G) 1 

Error gE. 
Within Subjects 

Slides (S) 9 

SXG 9 

Error 108 
Total 139 


Latency of Dilation (LD) 


df 
Between Subjects 
Pilot Groups (G) 1 
Error Ay 
Within Subjects 
Slides (S) 9 
SXG 9 
Error 108 
Total 139 


(NS = not significant p>.05) 


MS 


196459 


654, 64 


OR 22 


114, 20 


TSP7e 


MS 


OL 


9.02 


4.67 


iS 


1,08 


Le 


F 


0. 30 


O09 


VETS. 


Zee 


4, 31 


fol 


(NS) 


(NS) 


(NS) 


(NS) 


. 0001 


(NS) 





It was noted that the inverted VGI displays appeared to evoke a greater 
mean LD than the upright VGI displays. For PPDC note (Fig. 2) that no 
clear pattern emerges from the responses. 

The mean LD for the inverted VGI displays was 3.40 seconds, while 
the mean LD for the upright VGI displays was 2.57 seconds. The null 
hypothesis that the means are equal could be rejected at the .01 level 
(t=3.46, df=138). Using PPDC as the measure, the mean PPDC for the 
upright VGI displays was 10. 47 and for the inverted VGI displays was 9. 33. 
The null hypothesis of equality of the means could not be rejected 
(t=0.48, df=138). 

Each group was then examined separately to determine if there was 
a significant difference in response between the inverted and upright VGI 
displays. Using LD as the measure, both groups demonstrated a significant 
difference: 

Group A: inverted mean = 3.85 

upright mean = 2,82 
Reject Hp: means are equal at .01 level (t=2.51, d£=68) 
Group B: inverted mean = 2,94 

upright mean = 2, 32 

Reject Ha at .05 level (¢=2550)1de-58) 

Using PPDC as the measure, neither group demonstrated a significant 


difference in means: 
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Group A: inverted mean = 11.06 
upright mean = 10.85 

Cannot reject Hy (t=0.06, df=68) 

Group B: inverted mean = 7.61 
upright mean = 10.09 

Cannot reject Hp (t=0.79, d£=68) 

Disagreement between the two measures was also found when the 
data was tested to determine if there was a difference in the responses 
of the two groups for (1) the upright VGI displays, and (2) the inverted 
VGI displays. Using LD as the measure, the following results were 
obtained: 

Upright VGI Displays: Group A mean = 2.82 

Group B mean = 2. 32 
Can reject Hp: means are equal at .01 level (t=2.78, d£=54) 
Inverted VGI Displays: Group A mean = 3,85) 

Group B mean = 2.94 

Can reject Hp at .01 level (t=2.53, d£=82) 

Using PPDC as the measure, the following results were obtained: 

Upright VGI Displays: Group A mean = 10.85 

Group B mean = 10.09 

Cannot reject Hp (t=0.18, d£=54) 

Inverted VGI Displays: Group A mean = 11.06 


Group B mean = 7. 61 
Cannot reject Hg (t=1. 28, df=82, p .20) 


i 





Paivio and Simpson (1968) suggested that the latency of dilation, 

i.e. , the time from presentation of the stimulus until maximum pupil 
dilation is reached, may be a more sensitive indicator of mental effort 
than pupil diameter increase. This was substantiated by Colman and 
Paivio (1969). They also demonstrated that dilation during a cognitive 
task is enhanced when the subject is required to make an overt response 
indicating task fulfillment. It can thus be reasonably contended that if 
pupil diameter change had been significant in the present experiment, 
some doubts could have been raised about the validity of that significance, 
The fact that pupil diameter increase was not significant but the latency 
of dilation was, tends to support Simpson and Paivio's contention (1968) 
that latency of dilation is, in fact, a more sensitive indicator of the 
processing effort. 

Woodmansee (1966) recommended that pupillometric experimenters 
check for arousal decrement of subjects across trials. This arousal 
decrement, he noted, can occur as the result of boredom, fatigue or 
adaptation. In the present experiment, this was eliminated (as recom- 
mended by Pratt (1969) ) by using, as the dilation score, the percent 
change of diameter from control slide (d},) to maximum diameter occurring 
during stimulus slide presentation (d_,). Fig. 3is a plot of the percent 
of change of the base-line diameter across trials with trial 1 as the base 
figure. Note that most of the decrease occurred during the initial trials 


of the experiment. This appears to indicate that the subjects were 
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highly excited at the beginning of the experiment due to the newness of 
the experiment which even the instructions, demonstrations, and two 
practice trials could not eliminate. After viewing a few of the early 
slides , the subjects had apparently adjusted to the experiment and 
further changes were more gradual. 

During the experiment, two major procedural problems with the 
pupillometer arose which merit discussion and hopefully may aid other 
experimenters in their research efforts using the same instrument. 

It was observed on a number of occasions that obtaining an optimal 
crescent and black line on the TV monitor was almost impossible in spite 
of adjusting the camera viewing angle, the f-stop, and the light source. 
This was particularly true with subjects with light colored irises. Subjects 
with dark irises presented almost no problem. 

Subjects with long eyelashes or eyelashes that partially covered the 
iris prohibited obtaining accurate pupil measurement. The solution to 
this problem is a modification of the camera mount so that the camera 


can be tilted up slightly. 


Ha 





Note: 


Latency of Dilation (Sec. ) 





Slides 1-4 are upright VGI displays 
Slides 5-10 are inverted VGI displays 


——— All Subjects 
——-— Group A Pilots (Transport/Helo/Patrol) 
—~ — Group B Pilots (Fighter/Attack) 


Slide Number 


FIGURE 1. LATENCY QF DILATION (LD) 
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Note: Slides 1-4 are upright VGI displays 
Slides 5-10 are inverted VGI displays 
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APPENDIX A 


SIMULATED AIRGRAET ALTITUDES USED ASS Tina aI 


Slide Number Wing Position 


10 


Level 

Rt. Wing Down 
Lt. Wing Down 
Rt. Wing Down 
Level 

Lt. Wing Down 
Rt. Wing Down 
Rt. Wing Down 
Rt. Wing Down 


Lt. Wing Down 


AN) 


Nose Position 


Level 


Down 


Down 


Upright/ 

Inverted 
Upright 
Upright 
Upright 
Upright 
Inverted 
Inverted 
Inverted 
Inverted 
Inverted 


Inverted 
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LATENCY OF DILATION 
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BASE-LINE DIAMETER PERCENTAGE CHANGE 
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APPENDIX C 


FIGURES 
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THE SPACE SCIENCE MODEL 831D 


TELEVISION PUPILLOMETER 


FIGURE 4. 
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FIGURE 5. THE PUPILLOMETER AS SET UP WITH THE 
SLIDE PROJECTOR AND SCREEN 
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FIGURE 6. THE VERTICAL GYRO INDICATOR (VGI) 
IN THE UPRIGHT, NOSE UP, 
LEFT WING DOWN POSITION 
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FIGURE 7. THE VERTICAL GYRO INDICATOR (VGI) 
IN THE INVERTED, NOSE DOWN, 
RIGHT WING DOWN POSITION 
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APPENDIX D 


INSTRUCTIONS FOR SUBIECTS 


THIS IS AN EXPERIMENT TO TEST EYE RESPONSE TO VISUAL 
STIMULI. YOU WILL BE SEATED AT THE END OF THE TABLE WITH 
YOUR CHIN AND FOREHEAD RESTING IN THE FRAME, WHEN YOU ARE 
READY, A SLIDE OF A VGI WILL BE PROJECTED ON THE SCREEN. 
WHEN YOU HAVE ANALYZED THE VGI; THAT IS, DETERMINED THE 
ATTITUDE OF THE SIMULATED AIRCRAFT, PRESS THE BUTTON YOU 
HOLD IN YOUR HAND. THEN VERBALLY DESCRIBE THE AIRCRAFT 
ATTITUDE IN THE FOLLOWING TERMS: 

(1) NOSE UP/DOWN/LEVEL 

(2) INVERTED/UPRIGHT 

(3) LEFT WING DOWN/RIGHT WING DOWN/WINGS LEVEL 
THE ORDER IN WHICH YOU VERBALIZE THESE IS NOT IMPORTANT-- 
BUT PLEASE STATE ALL THE DESCRIPTORS. 

AFTER VERBALIZING THE RESPONSE, A FOCUSING SLIDE WITH 
THE NUMBER 5 IN THE CENTER WILL APPEAR. PLEASE FOCUS ON 
THE NUMBER. THE NEXT SLIDE WILL THEN BE PRESENTED. 

THE PUPILLOMETER IS VERY SENSITIVE TO HEAD MOVEMENTS, 
SO PLEASE DO NOT MOVE YOUR HEAD DURING THE COURSE OF THE 
EXPERIMENT. 


WE WILL NOW RUN THROUGH A TEST TRIAL OF THE EXPERIMENT 


TO FAMILIARIZE YOU WITH THE PROCEDURE AND THE DISPLAY. 
ANY QUESTIONS? 
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